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Abstract 

We examine some common features of minimal surfaces, nonzero constant 
mean curvature surfaces and marginally outer trapped surfaces, concerning 
their stability and rigidity, and consider some applications to Riemannian ge- 
ometry and general relativity. 

2000 Mathematics Subject Classification: 53C20, 83C57 

Keywords and Phrases: minimal surfaces, marginally trapped surfaces, 
black hole topology, positive mass theorems 

1 Minimal hypersurfaces in manifolds of nonneg- 
ative scalar curvature 

It is an honor to contribute a paper to this volume celebrating Rick Schoen's 60th 
birthday. Rick's work has had a tremendous influence on the research of so many of 
us working in the areas of differential geometry, geometric analysis and mathematical 
relativity. It is a pleasure to consider in this article some work of the author and 
others in which the impact of Rick's work is so strongly evident. 

In this first section we review some fundamental results of Schoen and Yau, along 
with some refinements of those results, concerning compact minimal hypersurfaces in 
manifolds of nonnegative scalar curvature. In the next section we discuss joint work 
with Schoen, and some refinements of that work, which show how some of the results 
described in this section extend to marginally outer trapped surfaces in general initial 
data sets satisfying the dominant energy condition. The results in this context yield 
a generalization of Hawking's black hole topology theorem to higher dimensions. In 
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Section 3, we describe a positive mass result for asymptotically hyperbolic manifolds, 
obtained in joint work with Andersson and Cai, which is proved via the general "min- 
imal surface methodology" of Schoen and Yau, and which, hence, does not require 
the assumption of spin. The proof makes use of natural extensions of the results dis- 
cussed in this section to positive constant mean curvature hypersurfaces in manifolds 
with negative lower bound on the scalar curvature. 

In the seminal papers [371 EH]; Schoen and Yau studied the question of which 
compact manifolds admit a metric of positive scalar curvature. Prior to this work, 
Lichnerowicz [32] had proved, using a Bochner type argument associated with the 
Dirac operator and the Atiyah-Singer index theorem, that compact 4/c-dimensional 
spin manifolds of positive scalar curvature must have vanishing A-genus. This was 
followed later by work of Hitchin [28], who also used the spinorial method to obtain 
further obstructions to the existence of metrics of positive scalar curvature. While 
these results are quite striking, they left open some very basic questions, for example, 
the question as to whether the fc-torus, k > 3, admits a metric of positive scalar cur- 
vature. Then in [37J, Schoen and Yau made a huge advance by proving, using minimal 
surface techniques, that if the fundamental group of a compact orientable 3-manifold 
contains a subgroup isomorphic to a nontrivial surface group then the manifold does 
not admit a metric of positive scalar curvature. This implies, of course, that the 
3-torus does not admit a metric of positive scalar curvature. In [39], Schoen and Yau 
generalized their techniques to higher dimensions, thereby establishing inductively 
the existence of a large class of compact manifolds, including tori, of dimension up 
to 7, that do not admit metrics of positive scalar curvature. The fundamental obeser- 
vation made in [39J is that if M n , 3 < n < 7, is a compact orientable manifold of 
positive scalar curvature then any nontrivial co dimension-one homology class can be 
represented by a manifold that admits a metric of positive scalar curvature. This is 
proved by choosing a manifold of least area in the homology class, and making use of 
the positivity of the stability operator, "rearranged" in an especially useful way. 

We would like to review this argument in a bit more detail. Let E n_1 be a compact 
two-sided hypersurface in an n-dimensional Riemannian manifold (M n ,g). With 
respect to a chosen unit normal field v along E, introduce the second fundamental form 
B of E, B(X, Y) = (Vx^, Y), 1,7 6 T p £, p G £, and mean curvature H = tr^f?, 
where h is the induced metric on E. 

Now assume £ is minimal, H = 0, and consider normal variations of E, i.e., 
variations t — > E 4 of E = E , — e < t < e, with variation vector field V = -§i\ t _ = <pN, 
<p G C°°(E). Let A(t) = area of E t ; then by the formula for the second variation of 
area, 





where L : C°°(E) C°°(E) is the operator, 





2 



By definition, E is stable provided A"(0) > 0, for all normal variations of S. From 
Rayleigh's formula for the principal eigenvalue Ai(L) of the stability operator L, we 
obtain the following well-known fact. 

Proposition 1.1. The following three conditions are equivalent: (i) E is stable, 
(li) Ai(L) > 0. (Hi) There exists E > 0, such that L{4>) > 0. 

The key geometric observation made by Schoen and Yau in [39] is the following. 

Proposition 1.2. Let (M n ,g), n > 3 be a Riemannian manifold with nonnegative 
scalar curvature, S > 0. IfYT 1 ^ 1 is a compact two-sided stable minimal hypersurface 
in M n then S n_1 admits a metric of positive scalar curvature, unless it is totally 
geodesic and Ricci flat, and S — along S n_1 . 

Proof. We give here a slight variation of the proof in [39]. Rather than compare 
the stability operator to the conformal Laplacian (which then requires n > 4), it 
was observed in |llj . that, by using a "nonstandard" conformal factor, one can work 
directly with the stability operator. 

The essential step taken by Schoen and Yau was to rewrite the stability operator 
in an especially useful way. From the Gauss equation one obtains, 

Ric(>, v) + \B\ 2 = ^{S+ \B\ 2 + H 2 - S E ) (1.3) 

= 1 -{S+\B\ 2 -Sz) (1.4) 

where is the scalar curvature of £ in the induced metric, and where in the second 
line we have used that S is minimal. Hence the stability operator L may be written 

as, 

L(cf>) = -A0 + ~(£ s -3- |5| 2 )0. (1.5) 
Now let be a positive eigenfunction associated to Xi(L), and consider E in the 
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conformally related metric h = (J)™- 2 h. The scalar curvature S of S in the metric h 
is given by, 

S = 0"^(-2A0 + S S + n ~l lV f ) 

n — 2 <p 

= <f>-^(2X 1 (L) + S+\B\ 2 + n ~l lV f ) ■ (1.6) 

n — 2 <p z 

By our assumptions, all terms on the right hand side of the above are nonnegative, 
and hence S > 0. Then by well-known results [3T| . either S admits a metric of 
positive scalar curvature or S vanishes identically. In the latter case, all terms on the 
right hand side of (11 .6p vanish. Using this in (jl.5p implies that Ss = 0. Then, by a 
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result of Bourguignon (see [31J), £ either carries a metric of positive scalar curvature 
or is Ricci flat. □ 

The exceptional case in Proposition 11.21 can occur. For example, it is not hard to 
construct a metric of nonnegative scalar curvature on the 3-sphere S 3 , such that S 3 
in this metric contains a stable minimal torus. The papers [121 ELT] considered the 
rigidity of Proposition 11.21 in the case that £ is area minimizing (rather than just 
stable) and is not of positive Yamabe type, i.e., does not admit a metric of positive 
scalar curvature. (The issue of such rigidity in three dimensions was raised in [22].) 
Since variations on the rigidity result obtained in [TT] have been useful for certain 
problems in general relativity (see [U [23] , as well as the following sections), we take 
some time here to recall this result. 

Theorem 1.3. Let (M n ,g), n > 3 be a Riemannian manifold with nonnegative scalar 
curvature, S > 0, and suppose S n_1 is a compact two-sided hyper surface in M n which 
locally minimizes area. If £ is not of positive Yamabe type then a neighborhood U 
of Yi splits, i.e., (U,g\u) is isometric to ((— e, e) x Y,,dt 2 + h), where h, the induced 
metric onE, is Ricci flat. 

The assumption that S "locally minimizes" area can be taken to mean, for exam- 
ple, that £ has area less than or equal to that of all graphs over £ with respect to a 
fixed Gaussian normal coordinate system. 

Proof. The original proof given in [TT] involves a deformation of the ambient space 
metric in a neighborhood of £ to a metric of strictly positive scalar curvature. The 
proof given here is patterned after the proof of Theorem 2.3 in [TJ (see also [231 IS]); 
and does not require such a deformation. 

Let %{u) denote the mean curvature of the hypersurface £ u : x — > exp x u{x)v ', u G 
C°°(£), u sufficiently small. H has linearization "H'(O) = L, where L is the stability 
operator (11.51) . But by Proposition II. 2\ L reduces to —A, and hence "H'(O) = —A. 
Since the kernel of "H'(O) consists only of the constants, the implicit function theorem 
implies that a neighborhood of £ is foliated by constant mean curvature hyper surf aces. 
More explicitly, there exists a neighborhood U of E such that, up to isometry, 

U=(-e,e)xE g\u = <t> 2 dt 2 + h t , (1.7) 

where h t = h^{t ) x)dx l dx^ (x % local coordinates on S), <p = 4>(t,x) and S t = {t} x S 
has constant mean curvature. Let A(t) = the area of T, t ; since S is locally of least 
area, we have that A(0) < A(t) for all t G (— e, e), for e small enough. 

Let H(t) denote the mean curvature of E t . H = H(t) obeys the evolution equation, 

rlFf 1 

^ = -A0 + -(S 2t - S - \Bf - iJ 2 )0, (1.8) 

(compare (11 ,5p ). Since S is minimal, H(0) = 0. We claim that H < for t G [0, e). If 
not, there exists t Q G (0, e) such that H'(t ) > 0. Let S be the scalar curvature of S to 
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in the conformally related metric h = 4> n ~ 2 h tQ . Arguing similarly as in the derivation 
of (11. 6p . Equation (II. 8p implies, 



S = ( j ) -^{2(l)- 1 H'{t G ) + S+ \B\ 2 + H 2 + 



n-1 |V0| 2 
n-2 4> 2 



) >0, 



(1.9) 



contrary to the assumption that E 4o « E is not of positive Yamabe type. 
Thus, H < on [0, e) as claimed, and hence, 



A'(t) = [ H<pdA < , for all t G [0, e) . 



(1.10) 



JT, t 



But since A = A(t) achieves a minimum at t — 0, it must be that A'(t) = for 
i G [0, e). Hence, the integral in (jl.lOp vanishes, which implies that H = on [0, e). 
A similar argument shows that H = on (— e, 0], as well. Equation (11.81) then implies 
that L(<f>) = on each E t , where L is as in Equation (11.51) . It then follows from 
Proposition 11.11 that each E 4 is stable. From Proposition 11.21 we have that each H t 
is totally geodesic, so that = for each t, and that (p depends only on t. By a 
simple change of t-coordinate in (11.71) . we may assume without loss of generality that 
0=1. The result follows. □ 

Remarks. If, in the setting of Theorem 11.31 E is assumed to be minimal and locally 
of least area only to one side of E (the side into which v points, say), then it is easy 
to check that one still gets a splitting locally to that side. 

Now, suppose E is a compact minimal hypersurface in M that separates M into 
an "inside" and an "outside" . We say that E is an outermost minimal hypersurface if 
there are no minimal hypersurfaces outside of and homologous to E. We say, further, 
that E is outer area minimizing if its area is less than or equal to the area of any 
other hypersurface outside of and homologous to it. Given an outermost minimal 
hypersurface E in M, if there is a mean convex barrier E' outside of and homologous 
to E, and if dim M < 7, then E will be outer area minimizing in the region W 
bounded by E and E', as can be seen by minimizing area in the homology class of 
E in W. See e.g., [301 ED] for natural conditions which guarantee the existence of 
outermost, outer area minimizing minimal hypersurfaces in Riemannian manifolds. 

Theorem 11.31 and the above remarks imply the following. 

Corollary 1.4. Let (M n ,g), n > 3 be a Riemannian manifold with nonnegative 
scalar curvature, S > 0. // E n_1 is an outermost, outer area minimizing minimal 
hypersurface in M n , then E™ _1 must be of positive Yamabe type. 

Proof. By Theorem 11.31 and the remarks above, if E is not of positive Yamabe type 
then an outer neighborhood of E will be foliated by minimal (in fact, totally geodesic) 
hypersurfaces isotopic to E, thereby contradicting the assumption that E is outermost. 



□ 
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We note that, in Corollary II A\ if E is outer area minimizing with respect to an 
asymptotically flat end, then the assumption of being outermost can be dropped. For, 
in this case, one can use Theorem 11.31 to show that the entire end splits, contrary to 
it being asymptotically flat. 

To conclude this section, we wish to mention a recent paper of Bray, Brendle and 
Neves (9], in which they obtain a rigidity result for least area 2-spheres, whose proof is 
similar in spirit to that of Theorem 11.31 Suppose (M, g) is a compact 3-manifold with 
7T2(M) 7^ 0. Denote by J the set of all smooth maps / : S 2 — > M which represent a 
non-trivial element of ^(M), and define 

A(M,g) = inf{area(5 2 ,r^) : / G 2). (1.11) 

The main result in [9] is then as follows. 
Theorem 1.5. We have 

A(M,g) ir£S< 8tt, (1.12) 

where S denotes the scalar curvature of (M, g) . Moreover, if the equality holds, then 
the universal cover of (M, g) is isometric to the standard cylinder 5 2 xK up to scaling. 

Thus, rigidity can be achieved even in the positive Yamabe case. The proof 
makes essential use of the Gauss-Bonnet theorem, and hence the restriction to three 
dimensions. The authors first establish a local splitting about an area minimizing 
2-sphere E, and then globalize. A key step in proving the local splitting is to obtain 
a foliation by constant mean curvature 2-spheres in a neighborhood of E, as in the 
proof of Theorem 11.31 A related rigidity result for least area projective planes has 
been obtained in j8]. Recent counterexamples to Min-Oo's conjecture [10] show that 
"least area" cannot be replaced by "stable" in the latter. 

2 Marginally outer trapped surfaces 

Some of the results presented in the previous section can be interpreted as state- 
ments concerning time- symmetric initial data sets in general relativity. In this section 
we shall consider some closely related results in general relativity, pertaining to the 
topology of black holes, which hold for general initial data sets. In this more general 
spacetime setting, minimal surfaces are naturally replaced by the spacetime notion of 
marginally outer trapped surfaces. 

The notion of a marginally outer trapped surface (MOTS) was introduced early 
on in the development of the theory of black holes. Under suitable circumstances, 
the occurrence of a MOTS in a time slice signals the presence of a black hole [23 EE] ■ 
For this and other reasons MOTSs have played a fundamental role in quasi-local 
descriptions of black holes; see e.g., [7]. MOTSs arose in a more purely mathematical 
context in the work of Schoen and Yau [ID] concerning the existence of solutions of 
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Jang's equation, in connection with their proof of positivity of mass. There have 
been significant advances in the analysis of MOTSs in recent years. We refer the 
reader to the survey article [3] which describes many of these developments, including 
the important connections between solutions of Jang's equation and the existence of 
MOTSs. 

Here we are mostly concerned with MOTSs in initial data sets. Let (M n+1 ,g) be 
a spacetime (time oriented Lorentzian manifold) of dimension n + 1, n > 3. By an 
initial data set in (M n+1 ,g), we mean a triple (M n ,g,K), where M is a spacelike 
hypersurface in M, and g and K are the induced metric and second fundamental 
form, respectively, of M. To set sign conventions, for vectors X, Y e T P M, K is 
defined as, K(X, Y) = (Vxu, Y), where V is the Levi-Civita connection of M and u 
is the future directed timelike unit normal vector field to M. 

Given an initial data set (M n , h, K), let £™ _1 be a closed (compact without bound- 
ary) two-sided hypersurface in M n . Then £ admits a smooth unit normal field v in 
M, unique up to sign. By convention, refer to such a choice as outward pointing. 
Then l + = u + v (resp. /_ = u — v) is a future directed outward (resp., future directed 
inward) pointing null normal vector field along E, unique up to positive scaling. 

The second fundamental form of E (viewed as a co-dimension two submanifold of 
(M n+1 ,g)) can be decomposed into two scalar valued null second forms, x+ and x—> 
associated to l + and respectively. For each p G E, x± is the bilinear form defined 
by, 

X ± : T p £ x T p £ R, X± (X, Y) = g{V x l±, Y) . (2.13) 

The null expansion scalars (or null mean curvatures) 6± of S are obtained by tracing 
X± with respect to the induced metric h on E, 

0± = tr hX ± = h AB X ±AB = div s / ± . (2.14) 

One verifies that the sign of 9± is invariant under positive scaling of the null vector 
field l±. Physically, 6 + (resp., 6L) measures the divergence of the outgoing (resp., 
ingoing) light rays emanating from E. In terms of the initial data (M n , h, K), 

9±=tr h K±H, (2.15) 

where H is the mean curvature of E within M (given by the divergence of v along E). 

For round spheres in Euclidean slices of Minkowski space, with the obvious choice 
of inside and outside, one has 6L < and 6 + > 0. In fact, this is the case in general 
for large "radial" spheres in asymptotically flat spacelike hypersurfaces. However, 
in regions of space-time where the gravitational field is strong, one may have both 
9- < and 6 + < 0, in which case E is called a trapped surface. Under appropriate 
energy and causality conditions, the occurrence of a trapped surface signals the onset 
of gravitational collapse and the existence of a black hole |27j . 

Focussing attention on the outward null normal only, we say that E is an outer 
trapped surface if 9+ < 0. Finally, we define E to be a marginally outer trapped 
surface (MOTS) if 9 + vanishes identically. 
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MOTSs arise naturally in a number of situations. Most basically, compact cross 
sections of the event horizon in stationary (i.e. steady state) black holes spacetimes are 
MOTSs. This may be understood as follows. The event horizon is a null hypersurface 
in spacetime ruled by null geodesies. By Hawking's area theorem (which requires 
the null energy condition), these null geodesies can only diverge towards the future. 
However in the stationary limit, this divergence vanishes, which implies that cross 
sections have 6 + = 0. 

In dynamical black hole spacetimes MOTSs typically occur inside the event hori- 
zon. There are old heuristic arguments for the existence of MOTSs in this case, based 
on considering the boundary of the trapped region inside the event horizon. These 
heuristic ideas have recently been made rigorous first by Andersson and Metzger [6] 
for three dimensional initial data sets, and then by Eichmair [191 120] for initial data 
sets up to dimension seven. These results rely on a basic existence result for MOTSs 
under physically natural barrier conditions. The proofs by these authors, based on 
an approach put forth by Schoen, involves inducing blow-up of Jang's equation; for 
further details, see [3] and references therein. 

Geometrically, MOTSs may be viewed as spacetime analogues of minimal surfaces 
in Riemannian manifolds. In fact, in the time-symmetric case (i.e. the case in which 
M is totally geodesic, K = 0), a MOTS £ is just a minimal hypersurface in M, as 
can be seen from Equation ( 12.151) . Despite the fact that MOTSs are not known to 
arise as critical points of some functional, they have been shown in recent years to 
share a number of properties in common with minimal surfaces. In particular, as first 
put forward by Andersson, Mars and Simon [HE], MOTSs admit a notion of stability 
analogous to that of minimal surfaces. Here, stability is associated with variations 
of the null expansion under deformations of a MOTS, as discussed in the following 
subsection. 



2.1 Stability of MOTSs 

Let E be a MOTS in the initial data set (M, g, K) with outward unit normal v. 
Consider a normal variation of £ in M, i.e., a variation t — > £ t of £ = So with 
variation vector field V = ^|t=o = <fiv, § £ C°°(£). Let 8(t) denote the null 
expansion of E t with respect to k = u + u t , where u is the future directed timelike 
unit normal to M and v t is the outer unit normal to E t in M. A computation shows, 



dt 



U<t>) , (2-16) 



i=0 



where L : C°°(E) C°°(E) is the operator [5], 

L{(j>) = -A<f> + 2(X, V0> + - (n + J{y)) - ^|x| 2 + div X — |X| 2 ) . (2.17) 

In the above, A, V and div are the Laplacian, gradient and divergence operator, 
respectively, on E, is the scalar curvature of E, A is the vector field on E dual 



to the one form K(u,-)\x, (,) = h is the induced metric on £, and /x and J are 
defined in terms of the Einstein tensor G = Ric^ — \RmQ : /x = G(xx, u), J — G(u, •). 
When the Einstein equations are assume to hold (see Section 2.2), /x and J represent 
the energy density and linear momentum density along M. As a consequence of the 
Gauss-Codazzi equations, the quantities /x and J can be expressed solely in terms of 
initial data, 



In the time-symmetric case, 9 in (12.161) becomes the mean curvature H, the vector 
field X vanishes and L reduces to the stability operator (11.51) of minimal surface 
theory. In analogy with the minimal surface case, we refer to L in (12.171) as the 
stability operator associated with variations in the null expansion 6. As observed in 
[5], although in general L is not self-adjoint, as a consequence of the Krein-Rutman 
theorem, its principal eigenvalue (eigenvalue with smallest real part) Ai(L) is real. 
Moreover there exists an associated eigenfunction which is strictly positive. 

Continuing the analogy with the minimal surface case, we say that a MOTS is 
stable provided Xi(L) > 0. Stable MOTSs arise in various situations. For example, 
outermost MOTSs, as we define in Section 2.2, are stable. This includes, in partic- 
ular, compact cross sections of the event horizon in stationary black hole spacetimes 
obeying the null energy condition. More generally, the results of Andersson and Met- 
zger, and of Eichmair alluded to above establish natural criteria for the existence 
of outermost MOTSs. And of course, in the time-symmetric case, stable minimal 
surfaces are stable MOTSs. 

We now present a key fact which allows, for example, some of the results on 
minimal surfaces in Section 1 to be extended to MOTSs in general initial data sets. 
Consider the "symmetrized" operator Lq : C°°(S) — » C°°(S), 



obtained by formally setting X = in (|2.17|) . The key argument in [23] used to obtain 
a generalization of Hawking's black hole topology theorem [27] shows the following. 

Proposition 2.1. Ai(L ) > Ai(L). 

Proof. The proof has its roots in arguments from [40J . Let be a positive eigenfunc- 
tion associated to Ai(Z). Completing the square on the right hand side of (I2.17p . and 
using L((p) = Ai(L)0 gives, 




(2.18) 



L o (0) = -A0 + f - (/x + J{v)) - \\x\ 2 ) <P . 



(2.19) 



A0+(Q + divX)0 + 0|Vln0| 2 -0|X- Vln0| 2 = Ai(L)0 



(2.20) 



where Q:=\S-{n + J{v)) ~\\x 



2 . Letting u = ln<f), we obtain, 



Aw + Q + divX- \X-Vu 



2 



Ax(L). 



(2.21) 
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Absorbing the Laplacian term Au = div (Vw) into the divergence term gives, 

Q + div (X - Vu) - \X - Vu\ 2 = Ai(Z). (2.22) 

Setting Y = X — Vw, we arrive at, 

-Q + \Y\ 2 + Ai(L) = divF . (2.23) 

Given any ^ e C°°(E), we multiply through by ?/> 2 and derive, 

-^ 2 Q + tp 2 \Y\ 2 + ^ 2 Ai(L) = ^ 2 divF 

= div (ip 2 Y) -2ip(Vip,Y) 

< div (4) 2 Y) + 2|V||V^||y| 

< div (ip 2 Y) + |V-0I 2 + ^ 2 |y| 2 - 

Integrating the above inequality yields, 

f |WI 2 + O-^ 2 

Ai(X) < Jsl , ,T Vy for all V e C°°(S), ^ ^ . (2.24) 

Proposition 12.11 now follows from the well-known Rayleigh formula for the principal 
eigenvalue applied to the operator (12.191) . □ 

When £ is stable, the left hand side of (12. 22ft is nonnegative. The resulting 
inequality is intimately related to the stability inequality (2.29) for solutions to Jang's 
equation obtained by Schoen and Yau in [ID]. For further discussion of the connection 
between Jang's equation and MOTSs, see e.g. [3]. 



2.2 A generalization of Hawking's black hole topology theo- 
rem 

A basic step in the proof of the classical black hole uniqueness theorems is Hawking's 
theorem on the topology of black holes [27] which asserts that compact cross-sections 
of the event horizon in 3 + 1-dimensional asymptotically flat stationary black hole 
space-times obeying the dominant energy condition are topologically 2-spheres. The 
remarkable discovery of Emparan and Reall [21] of a 4 + 1 dimensional asymptotically 
flat stationary vacuum black hole space-time with horizon topology S 1 x S 2 , the so- 
called "black ring", showed that horizon topology need not be spherical in higher 
dimensions. This example naturally led to the question of what are the allowable 
horizon topologies in higher dimensional black hole space-times. This question was 
addressed in the papers of [2H [23], resulting in a natural generalization of Hawking's 
black hole topology theorem to higher dimensions, which we now discuss. 

Let (M n+l ,g), n > 3, be a spacetime satisfying the Einstein equations (with 
vanishing cosmo logical term), 

Ric M --R M 9 = T, (2.25) 
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where Ricjg and are the Ricci tensor and scalar curvature of (M n+1 ,g), respec- 
tively, and T is the energy momentum tensor. (M n+1 ,g) is said to satisfy the dom- 
inant energy condition (DEC) provided T{X, Y) = TijX l Y^ > for all future di- 
rected causal vectors X, Y. This translates to the spacetime curvature condition, 
G(X, Y) = GijX % Yi > 0, where G = Ric^ — \RmQ is the Einstein tensor. One 
verifies that if (M n+1 ,g) satisfies the DEC then for every initial data set (M n ,g,K) 
in (M n+1 ,g) one has // > \ J\ along M, where \i = G(u,u) and J = G(u,-). Recall 
from equation f 1 2 . X 8 [) . that the energy density \i and linear momentum density J along 
M can be expressed solely in terms of initial data. Note that in the time-symmetric 
case, fj, = |Se and J = 0. 

The following result of Schoen and the author [23], which generalizes Hawking's 
black hole topology theorem, is a spacetime analogue of Proposition 1 1 . 2 1 in Section 1. 

Theorem 2.2. Let (M n , h, K) , n> 3, be an initial data set such \i > \ J\ along M. 
IfE is a stable MOTS in M then E is of positive Yamabe type, unless E is Ricci flat 
(flat if n = 3,4), % — and //+ J{y) = along S. 

Comment on the proof. Since £ is stable, Ai(L) > 0, where L is the MOTS stability 
operator (I2.17p . By Proposition 12. 1[ we have Ai(Lo) > 0. Noting the similarity 
between L and the minimal surface stability operator L in ( ll.5p . we see that to 
complete the proof of Theorem 12.21 one can argue just as in the proof of Proposition 
ll.2[ by using a positive eigenfunction associated to Ai(L ) to construct the relevant 
conformally related metric. The only other difference is that the nonnegative quantity 
+ \ \B\ 2 appearing in (I1.6P is now replaced by the nonnegative quantity fi + J(v) + 

\\x\ 2 - □ 

Thus, apart from certain exceptional circumstances, a stable MOTS £ in an initial 
data set satisfying the DEC, must be of positive Yamabe type. But E being positive 
Yamabe implies many well-known restrictions on its topology. We single out a couple 
of cases here; for simplicity assume S is orientable. In the standard case: dim E = 
2 (dim M = 3 + 1), E admits a metric of positive Gaussian curvature and so is 
diffeomorphic to a 2-sphere by Gauss-Bonnet. Hence we recover Hawking's theorem. 
In the case dim E = 3 (dim M = 4 + 1), it is known by results of Schoen- Yau [3H] and 
Gromov-Lawson [26] that E must be diffeomorphic to (i) a spherical space (a quotient 
of the 3-sphere - by the positive resolution of the Poincare conjecture!), or (ii) S 2 x S 1 
or (iii) a connected sum of the previous two types. Thus, the basic horizon topologies 
in the case dim E = 3 are 5* 3 and S 2 x S l , the latter being realized by the black ring 
of Emparan and Reall. For further restrictions on horizon topology within the class 
of stationary black hole spacetimes in 4 + 1 dimensions, see [29J . 

A drawback of Theorem 12.21 is that, when the DEC along (M, g, K) does not hold 
strictly, it allows certain possibilities that one would like to rule out. For example, 
it does not rule out the possibility of a vacuum black hole spacetime with toroidal 
topology. In fact it is easy to construct initial data sets obeying the DEC with stable 
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toroidal MOTSs. However these exceptional cases can be eliminated by strengthening 
the stability assumption. 

As noted in Section 2, stable MOTSs often arise as outermost MOTSs. Let E 
be a MOTS in an initial data set (M,g,K) that separates M into an "inside" and 
an "outside". We say that E is outermost if there are no outer trapped {6+ < 0) or 
marginally outer trapped (6> + = 0) surfaces outside of and homologous to S. If E 
is outermost it is necessarily stable, for otherwise, using a positive eigenfunction <fi 
associated to Ai(L) < to define a normal variation t — > E t of E = E , one sees that 
for small t > 0, Ej is outer trapped. (The term "outermost" here is partially justified 
by the fact that, under a natural exterior barrier condition, and up to dimension 
seven, if there exists an outer trapped surface E' outside of and homologous to E, 
then there will exist a MOTS outside of and homologous to E'; see [3] and references 
cited therein.) 

The following result, roughly similar to Corollary II. 4} and proved in [23], rules 
out the exceptional cases. 

Theorem 2.3. Let (M n ,g,K), n>3, be an initial data set in a spacetime obeying 
the DEC. 7/E™ -1 is an outermost MOTS in (M n ,g,K) then it is of positive Yamabe 
type. 

This theorem is an immediate consequence of the following rigidity result (compare 
Theorem II. 31) . 

Theorem 2.4. Let (M n , h, K) , n > 3, be an initial data set such that \x > \ J\ along 
M , and such that r = tr g K < 0. Suppose E is a separating MOTS in M such that 
there are no outer trapped surfaces (6 + < 0) outside of, and homologous, to E. IfT, is 
not of positive Yamabe type, then there exists an outer half-neighborhood U ~ [0, e) x E 
o/E in M such that each slice E t = {t} x E, t 6 [0, e) is a MOTS. In fact each E t has 
Xt — 0, and is Ricci flat. Moreover, if the DEC holds in a spacetime neighborhood of 
E then the mean curvature condition, r < can be dropped. 

Remarks on the proof. The proof of Theorem 12.41 while somewhat more involved, is 
similar to the proof given here of Theorem 11.31 First one uses stability to obtain an 
outer foliation t — > E t , < t < e, of surfaces E t of constant outer null expansion, 
6(t) = c t . Then one shows that the constants c t = 0. The proof of this makes use 
of the formula for the t-derivative, not just at t = where 9 = 0, but all along 
the foliation t — > Et, where, a priori, 8(t) need not be zero. Thus, additional terms 
appear in the expression for ^ beyond those appearing in (12.16p -( j2T7j) . including 
a term involving the mean curvature r of M, which need to be accounted for. By 
making a small deformation of M near E in spacetime, one can eliminate the mean 
curvature condition on M, provided the DEC holds in a neighborhood of E. We are 
working on an approach to eliminate this deformation step, so as to obtain a pure 
initial data version of Theorem 12.41 without the mean curvature condition. 
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3 Positivity of mass for asymptotically hyperbolic 
manifolds 



Without a doubt one of the most beautiful and powerful applications of minimal 
surface theory to manifolds of nonnegative scalar curvature is Schoen and Yau's proof 
of the positive mass theorem [38] for maximal three-dimensional initial data sets. In 
[35] Schoen showed by an inductive argument how to extend their positive mass result 
up to dimension seven. 

Theorem 3.1 (Riemannian PMT). Suppose (M n ,g), 3 < n < 7, is an asymptotically 
flat manifold with nonnegative scalar curvature, S > 0. Then M has ADM mass > 0, 
and = iff M is isometric to Euclidean space. 

Developments in physics over the past decade, in particular the emergence of the 
AdS/CFT correspondence, has heightened interest in the geometrical and physical 
properties of asymptotically hyperbolic (AH) manifolds. Such manifolds arise natu- 
rally as spacelike hypersurfaces in asymptotically anti-de Sitter spacetimes. In [25], 
Gibbons et al. adapted Witten's spinorial argument to prove positivity of mass in 
the 3 + 1 dimensional asymptotically AdS setting. More recently, Wang pLT] , and, 
under weaker asymptotic conditions, Chrusciel and Herzlich [16] provided precise def- 
initions of the mass in the asymptotically hyperbolic setting and gave spinor based 
proofs of positivity of mass in dimensions > 3. These latter positive mass results may 
be paraphrased as follows: 

Theorem 3.2. Suppose (M n ,g), n > 3 ; is an asymptotically hyperbolic spin manifold 
with scalar curvature S > —n(n — 1). Then M has mass > 0, and = iff M is 
isometric to standard hyperbolic space H n . 

Physically, M corresponds to a maximal (mean curvature zero) spacelike hyper- 
surface in spacetime satisfying the Einstein equations with cosmological constant 
A = — n(n — l)/2. For then the Gauss equation and DEC imply 5* > —n(n — 1). We 
note that, in the present context, the mass in Theorem 13.21 refers, more precisely, to 
the energy component of a suitably defined energy-momentum vector [161 E] ■ 

The aim of the paper jlj was to obtain a positive mass theorem for asymptotically 
hyperbolic (AH) manifolds which does not require the assumption of spin, with the 
idea of replacing the spinor based arguments by the "minimal surface" methodology 
of Schoen and Yau, adapted to a negative lower bound on the scalar curvature. The 
specific approach taken in [1] was inspired by Lohkamp's [33] variation of the Schoen- 
Yau proof. Lohkamp circumvented many of the technical issues in [38] associated 
with the construction and analysis of a complete noncompact minimal surface, by 
compactifying the problem. This allows one to appeal to results on compact manifolds 
of nonnegative scalar curvature in [39] which do not require the assumption of spin. 
Recall, under the assumptions of Theorem I3.2[ Lohkamp shows that if the mass 
is negative then the metric g can be deformed to a metric g having nonnegative 
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scalar curvature, S > (with S > at some points) such that (M, g) is isometric 
to Euclidean space (R n , g Q ) outside a compact set. But then this contradicts the 
following result, first proved by Schoen and Yau in dimension three [36l 137]. 

Theorem 3.3 (Precursor to PMT). Suppose that (M n ,g), 3 < n < 7, has nonneg- 
ative scalar curvature, S > 0, and is isometric to (M. n ,go) outside a compact set K. 
Then (M n ,g) is globally isometric to (M. n ,g Q ). 

Recall, to prove Theorem I3.3[ one encloses K in a large n-dimensional cube, 
with sides in the Euclidean region. Then, by identifying sides pairwise one obtains a 
compact manifold of the form T n j^N with nonnegative scalar curvature. By Corollary 
2 in [39J, such a manifold must be flat. (If N is spin, this follows from results of 
Gromov and Lawson for all n > 3; see [26J and references cited therein.) Thus, 
(M n ,g) is globally flat, and Theorem 13.31 follows. 

The idea of the paper [I] was to carry out a similar plan to prove a version of 
Theorem 13.21 without spin assumption. This plan consists of two parts: a deformation 
part and a rigidity part. The defomation part is to show in the AH setting, that if 
the mass is negative then one can deform the metric near infinity to make it exactly 
hyperbolic outside an arbitrarily large compact set, while retaining the scalar curva- 
ture inequality, S > —n(n — 1). We will say a bit more about this part at the end. 
The rigidity part is to obtain a hyperbolic analogue of Theorem 13.31 In fact, in p] 
the following rigidity result was established. 

Theorem 3.4. Suppose (M n ,g), 3 < n < 7, has scalar curvature S satisfying, 
S > —n{n — 1), and is isometric to HP outside a compact set. Then (M n ,g) is 
globally isometric to HP. 

In the case that (M n ,g) is a spin manifold, this theorem follows from a result of 
Min-oo [M] (see also [21 [18] ) , as well as from the rigidity part of Theorem 13.21 The 
main point of Theorem 13.41 is that it does not require a spin assumption. We wish 
to take some time here to discuss the proof, as it relates closely to themes already 
developed in the first two sections. The proof is based on a study of minimizers of 
the 'BPS brane action', as it is referred to in [42] . 

3.1 The brane action 

Let (M n ,g) be an oriented Riemannian manifold with volume form Q. Assume there 
is a globally defined form A such that Q = dA. Let E be a compact orientable 
hypersurface in M. Then E is 2-sided in M, and hence admits a smooth unit normal 
field u, which we refer to as outward pointing. Let S have the orientation induced 
by v (i.e., determined by the induced area form u = i u Q). Then, for any such E, we 
define the brane action B by, 

B(E) = A(E) - (n - l)V(S) , (3.26) 
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where *4(E) = the area of E, and V(E) = J E A. If E bounds to the inside then, by 
Stokes theorem, V(E) = the volume of the region enclosed by E. Although A is not 
uniquely determined, Stokes theorem shows that, within a given homology class, B is 
uniquely determined up to an additive constant. 

We now consider the formulas for the first and second variation of the brane action. 
Let t — > E 4 , — e < t < e, be a normal variation of E = E , with variation vector field 
V = §- t \ t=Q = <pv, (f) e C°°(E). Abusing notation slightly, set B(t) = £(£*). Then for 
first variation we have, 

B'(0) = I (H - (n- l))(j)dA (3.27) 
Jt, 

Thus E is a stationary point for the brane action if and only if it has constant mean 
curvature H = n — 1. 

Assuming E has mean curvature H = n — 1, the second variation formula is given 

by 

B"(0) = [ <j)L{<t>)dA, (3.28) 

where L is just as in (jl.2p . Using (II. 3p and the fact that H = n — 1, L can be 

expressed as, 

L((f>) = -A0 + i(S E - S n - \B \ 2 ) <p , (3.29) 

where S n = S + n(n — 1) and Bq is the trace free part of B, Bq = B — h, where h is 
the induced metric on E. We note that, in our applications, S n will be nonnegative. 

A stationary point E for the brane action is said to be S-stable provided for all 
normal variations t — > E t of E, B"(0) > 0. As in Section 1, E is £>-stable if and only 
if Ai(L) > 0, where L is the brane stability operator (13. 29ft . 

In close analogy with Proposition 11.21 one obtains, by essentially the same argu- 
ment, the following. 

Proposition 3.5. Let (M n ,g), n > 3, be an oriented Riemannian manifold having 
scalar curvature S > — n{n — 1). If 'E is a compact orientable B-stable hypersurface 
in M which does not admit a metric of positive scalar curvature then (i) E is umbilic; 
more precisely, B = h, where h is the induced metric on E ; and (ii) E is Ricci flat 
and S = —n(n — 1) along E. 

This infinitesimal rigidity result is used in the proof of the following warped prod- 
uct splitting result. 

Theorem 3.6. Let (M n , g) be an oriented Riemannian manifold with scalar curvature 
S > —n(n — 1). Let E be a compact orientable hypersurface in M which does not 
admit a metric of positive scalar curvature. If E locally minimizes the brane action 
B then there is a neighborhood U of 'E such that (U,g\u) is isometric to the warped 
product ((— e, e) x E, dt 2 + e 2t h), where h, the induced metric on E, is Ricci flat. 
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As noted in Section 1, the proof of Theorem 13.61 given in [T] is very similar to 
the proof given here of Theorem 11.31 A related result in three dimensions has been 
obtained in |43l Theorem 3.2]. 

3.2 Proof of Theorem ETH 

We briefly outline the proof of Theorem 13.41 While, unlike the asymptotically flat 
case, there does not appear to be a way to fully compactify, our approach taken in [T] 
is to partially compactify and then minimize the brane action in a certain homology 
class. 

We are assuming that outside a compact set K, (M n , g) is isometric to hyperbolic 
space EP. For our purposes, it is convenient to work with an explicit representation 
of H n . We start with the half-space model (H n , gn), where, H n = {(y, x 1 , • • • , x n_1 ) : 
y > 0}, and 

9h = \ {dy 2 + (dx 1 ) 2 + ■■■ + (dx^ 1 ) 2 ) , (3.30) 

and make the change of variable y = e~*, to obtain H n = (R n ,gi), where, 

9l = dt 2 + e 2t ((dx 1 ) 2 + ■■■ + (dx 71 - 1 ) 2 ) . (3.31) 

To partially compactify, we periodically identify the x l coordinates. Choosing 
a > sufficiently large, we can enclose the compact set K in an infinitely long 
rectangular box, with sides determined by the "planes", x l = ±a. We then identify 
the sides of the box pairwise to obtain an identification space (M, g) such that outside 
the compact set K, and up to isometry we have, 

M = RxT n -\ g = dt 2 + e 2t h, (3.32) 

where h is a flat metric on the torus T n ~ l . Thus, (M, g) is just a standard hyperbolic 
cusp "perturbed" on the compact set K, with scalar curvature satisfying 5 > —n(n — 
1) everywhere. 

Claim. (M,g) has constant curvature —1 everywhere. 

The claim implies that the original manifold (M,g), from which (M,g) was con- 
structed, has constant curvature —1 everywhere. This implies that (M,g) is covered 
by H n , with the covering map a local isometry. But since (M,g) is simply connected 
at infinity, the covering map must be an isometry, and Theorem 13.41 follows. 

We give a sketch of the proof of the claim. Choose b > large enough so that 
K lies between the toroidal slices t = ±b, and fix a t-slice S io = {t } x T n , t > b, 
with outward pointing normal v — J^. We now minimize the brane action in the 
homology class determined by £ <0 . Let S% be a minimizing sequence for the brane 
action in this homology class. The t-slices \t\ > b, have mean curvature H = n — 1, 
and hence act as barriers for the minimization procedure. Consequently, the S[s can 
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be chosen to lie in the compact region between the slices t = ±6. Thus, by the 
compactness results of GMT, a subsequence converges to a smooth (provided n < 7) 
compact hypersurface S homologous to S to , which minimizes the brane action in its 
homology class. Without loss of generality we may assume S is connected; otherwise 
restrict attention to one of its components. The "almost product structure" of M 
(cf., Equation (13.321) ) implies the existence of a nonzero degree map from S to the 
toroidal slice S 4o . By Corollary 2 in [37] , S does not admit a metric of positive scalar 
curvature (and any metric of nonnegative scalar curvature on S must be flat). Then, 
by Theorem 13.61 a neighborhood U of S splits as a warped product, 

U = (-u ,u )xS g\u = du 2 + e 2u h, (3.33) 

where the induced metric h on S is flat. But since S globally minimizes the brane 
action in its homology class, this local warped product structure can be extended to 
arbitrarily large w-intervals. Hence K will eventually be contained in this constructed 
warp product region. The claim now follows. (In fact, with a bit more effort, these 
arguments show that Equations 13.321 hold globally.) □ 

We conclude with a few words about the deformation step. In [Ij, we adopted the 
definition of the mass of an asymptotically hyperbolic manifold used by Wang |JT] ■ 
By a change of coordinates this implies that there is a relatively compact set C such 
that M \ C = S n x [R, oo), R > 0, and on M \ C, g has the form, 

g = ^—dr 2 + r 2 h r , (3.34) 
1 + r z 

where h r is an r-dependent family of metrics on S n of the form, 

h r = ho + — k + 7 r , (3.35) 

where h is the standard metric on S n , A; is a symmetric 2-tensor on S n and 7 r is an 
r-dependent family of metrics on S n whose components satisfy specific higher order 
decay rates. We refer to k as the mass aspect tensor; it is the leading order measure 
of the deviation of the metric g from the hyperbolic metric. Its trace with respect 
to ho, tih k, is called the mass aspect function. Up to a normalizing constant, the 
integral of the mass aspect function over the sphere defines the mass of (M,g), mass 
= Jgn tr^ k. 

What is shown in [I], is that if the mass aspect function is pointwise negative, 
then sufficiently far out on the end we can deform the metric to the hyperbolic metric, 
while preserving the scalar curvature inequality S > —n(n — 1); see Theorem 3.2 in [1] 
for a more precise statement. But this deformation result is seen to be incompatible 
with Theorem 13.41 Moreover, using Theorem 13.41 it is shown that if the mass aspect 
function vanishes identically then (M n ,g) is isometric to hyperbolic space. Putting 
all of these results together yields the following positive mass statement obtained 
in [TJ. 



17 



Theorem 3.7. Let (M n ,g), 3 < n < 7, be an asymptotically hyperbolic manifold 
with scalar curvature S > —n(n + 1). Assume that the mass aspect function does not 
change sign, i.e. that it is everywhere either negative, zero, or positive. Then, either 
the mass of (M, g) is positive, or (M, g) is isometric to hyperbolic space. 

Naturally, it would be desirable to find a way to remove the sign condition on the 
mass aspect. Within the context of the approach taken in [I], one possible way to 
accomplish this would be to suitably extend the results of Corvino-Schoen [17] and 
Chrusciel-Delay [13] on initial data deformations to the asymptotically hyperbolic 
setting. Some partial progress in this direction has been made in [14] . 
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